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Improved Home Network, Browser Based, Command and Control 
background of the invention 

1, Field of tf^PlnVffrtjffl 

The present invention relates to the field of netwoxks, and more particularly, to method 
and apparatus for performing services on browser based home networks for controlling home 
devices. 

2. Description of Related Art 

A typical household contains several home devices. As used in this document, the 
term "home device** encompasses all electronic devices that are typically found in the home, 
with the exception of general piupose computers O.e. personal con^mters (PCs), laptop 
computers, etc). For example, the term home device includes but is not limited to such 
electronic devices as security systems, theatfe equipment (e.g., TVs, VCRs, stereo equipment, 
and direct broadcast satellite services or (DBSS), also known as digital satellite services 
(DSS)), sprinkler systems, lighting systems, micro waves, dish washers, ovens/stoves, and 
washers/dryers. IxKleed, an automobile may be a home device. On the other hand, the term 
"device** as used in this document may comprise logical devices or other units having 
functionality and an ability to exchange data, and may include not only all home devices but 
also general purpose computers. 

In general, home devices are used to perform tasks thai enhance a homeowner's life 
style and standard of living. For example, a dishwasher performs the task of washing dirty 
dishes and relieves the homeowner of having to wash the dishes by hand. A VCR can record 
a TV program to allow a homeowner to watch a particular program at a later time. Security 
systems protect the homeowner's valuables and can reduce the homeowner's fear of unwanted 
entry. 

Home devices (such as home theatre equipment) are often controlled using a single 
common control unit, namely a remote control device. This single common control unit 
allows a homeowner to control and comnumd several different home devices using a single 
interface. Thus, many manufacturers have developed control units for controlling and 
commanding their home devices from a single interface. 

One drawback associated with using the remote control unit to command and control 
home devices is thai it provides static control and command logic for controlling and 
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commanding each home device. Therefore, a particular remote control unit c&i only control 
and command those home devices for ^^ch it includes the necessary control and command 
logic. For example* if a remote control unit comprises logic for controlling a television (TV), 
a video cassette recorder (VCR), and a digital video device (DVD), but not a compact disk 
5 (CD) unit, the remote control unit can not be used to command and control the CD unit In 
addition, as new home devices are developed, the remote control unit will not be able to 
control and command the new home devices that require control and command logic that was 
not known at the time the remote control unit was developed. 

Another drawback associated with using remote control units is that known remote 

10 control imits cannot control a plurality of diverse devices, and more particularly cannot 

control a plurality of devices having different capabilities to communicate with each other in 
order to provide a service. 

Therefore, there is a need for a method and q}paratu8 for controlling diverse devices to 
communicate in order to provide a service. There is also a need to provide a method and 

IS apparatus for controlling diverse devices over a home network, using a browser based 
approach, to perform a service in accordance with the respective capabilities thereof. 

SUMMARY OF THE INVENTION 

It is accordingly an object of the invention to overcome the problems of the prior art, 
and to provide a method and apparatus for control of a plurality of devices on a home network 
20 to perform a service. 

It is a more specific object of the invention to provide method and apparatus for 
providing a user inter&ce on a client device to permit a user to select and control a plurality of 
diverse devices to communicate and perform a service. 

The present invention accordingly provides a method and system for controlling home 
25 devices on a home network to communicate with each other for performing a service over the 
home network. 

According to one aspect of the invention, a method for performing a service on a 
home network having a plurality of home devices cormected thereto mcludes the steps of: 
connecting a client device to the home network, whereb the device is capable of displaying a 
30 user interface; executing a software agent on the dicnt device, vt^erein executing the software 
agent causes a user interface to be displayed on the client device; selecting a first home device 
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from the user inter&ce being displayed on the device* wherein the first home device is 
connected to the home network; selecting a second home device from the user interface being 
dasplayed on the device, wherein the second home device is coxmected to the home network; 
and sending control and command data from the client device to the first and second home 
5 devices to cause the first and second home devices to communicate with each other to 
perform the service. 

In accordance with one feature of the invention, the step of executing a software agent 
comprises executing a session manager program for acting on behalf of the user and for 
assisting the user. 

10 Where a session manager is executed, the client device may include means for 

generating a human graphical user interface (GUI), and the step of executing the session 
manager on the client deface may thus include the step of getkerating and displaying on the 
client device a graphics tiser interface object page containing device buttons associated with 
the first home device axul the second home device. 

15 The client device may include a browser for generating a human graphical user 

inter&ce (QUI), which may be coded in HTML, wherein the HTML coded graphics user 
inter&ce object may include a page containing device buttons associated with the first home 
device and the second home device. 

According to anodier feature of the invention, the step of selecting the first home 

20 device includes the step of reading a first home device cepabilities file, wherein the first home 
device d^ubilities file identifies the capabilities of the first home device; and the step of 
selecting the second home device includes the st^ of reading a second home device 
capabilities file, wherein the second home device c^abilitics file identifies the c^abilities of 
the second home device, and the method fiirther includes the step of matching contents of the 

25 first and second home device c^abilities files. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects and features of the present invention, which arc believed to be novel, are 
set forth with particularity in the appended claims. The present invention, both as to its 
organization and manner of operation, together with further objects and advantages, may best 
30 be understood by reference to the following description, taken in connection with the 
accompanying drawings, in which: 
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FIG. 1 is a block diagram of a home network constructed in accordandb with the 
present invention; 

FIG. 2 illustrates an example of a layered interface model that can be used for 
commurucating between home devices in accordance with the present invention; 

FIGS. 3 A and 3B are block diagrams illustrating controlling and commanding of a 
home device using a browser based Digital TV (DTV) according to one embodiment of the 
present invention and a specific exan^le; 

FIG. 4A is a block diagram illustrating a home device discovery mechanism according 
to one embodiment of the invention; 

FIG. 4B depicts a flow diagram illustrating the generation of a device list file 
according to certain embodiments of the invention; 

FIG. 5A is a block diagram of a device link page in accordance with the present 
invention; 

FIG. SB illustrates an example of a home device tree structure according to certain 
embodiments of the invention; 

FIG. 6 graphically depicts a view of a device link page in accordance with the present 
invention; 

FIG. 7 graphically depicts an alternative view diagram of a de^ce link page in 
accordance with the present invention; 

FIG. 8 graphically depicts a preliminary view of a session page in accordance with the 
present invention; 

FIG. 9 is a block diagram illustrating a sesnon manager causing two home devices to 
communicate over a home network according to certain embodiments of the invention; 

FIG. 1 0 graphically de^cts a secondary view of the session page in accordance with 
the present invention; 

FIG. 1 1 graphically depicts a third view of die session page in accordance with the 
present invention; 

FIG. 12A is a block diagram of a session juige in accordance with the present 
invention; 

FIG. 12B is another block diagram of the session page in accordance with the present 
invention; 

FIG. 1 3 is another block diagram of the sesaon page in accordance wi& the present 
invention; 
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FIO. 14 is a block diagram of a home network that is comiected to the^Intemet in 
accordance vnth the present inventions; 

FIG. 15 is a diagram illustrating the creation of a macro according to one embodiment 
of the invention; and 

S FIG. 1 6 is a diagram illustrating the creation of a macro according to another 

embodiraeot of the invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The following description is provided to enable any person skilled in the art to make 
and use the invention and sets forth the best modes presently contemplated by the inventors of 

10 carrying out their invention of a method and apparatus for controlling home devices over a 
home netwozk. In the following description, for purposes of explanation, numerous specific 
details are set forth in order to provide a thorough understanding of the present invention. It 
will be apparent, however, to one skilled in the an that the present invention may be practiced 
withotit these specific details. In other instances, well-known structures and devices are 

IS shown in block diagram form in order to avoid unnecessarily obscuring the present 
inventions. 

In an exemplary embodiment of the present invention, a browser based home network 
uses Intenket technology to control and conunand home devices that are connected to a home 
network. Each home device contains interface data (e.g. HTML, XML, JAVA, 

20 JAVASCRIPT, OIF, JPEG, graplucs files, or any other format useful for the intended 

purpose) that provides an interface for the commanding and controlling of the home device 
over the home networlc In certain embodiments, each home device contains one or more 
Hypertext Markup Language (HTML) pages that provide for the commanding and controlling 
of the home device. Using the browser technology, the home network employs Internet 

2S standards to render the HTML pages in order to provide users with a plurality of graphical 
user interfaces (**GUIs*') for commanding and controlling each home devices. In one 
embodiment, the home network is configured as an intranet. 

FIG. 1 is a block diagram of a home network 100 constructed in accordance with one 
embodiment of the present invention. As depicted in FIG. 1, a 1 394 serial bus 1 14 

30 electronically connects multiple home devices on the home network 1 00. In this example, the 
1394 serial bus 1 14 provides the physical layer (medium) for sending and receiving dau 
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between the various connected home devices. The 1394 serial bus 1 14 supports both time- 
multiplexed audio/video (AAO streams and standard ff (Internet Protocol) communications. 
In certain embodiments, the home netwoik uses an IP oetwotk layer as fhe communication 
layer for fhe home network 1 00. However, other communication protocols could be used to 
provide communication for the home network. For example, the invention may be 
implemented using FCP (Function Control Protocol) as defined by BSC 61883, or any other 
appropriate protocol. Ihus, a network may generally include two or mm devices 
interconnected by a physical layer ibr exchange or transfer of data in accordance with a 
predefined communication protocol. 

FIG. 2 illustrates an example of a layered interface model that can be used for 
communicating between home devices in accordance with the present invention. In this 
example, a home device (server) 150 communicates with a honoe device client 166 using 
netwoik communication layers 152-164. By employing the Internet Protocol standard for the 
networic layer 160, the home devices can commum'cate with each other without having to 
know specific details about the other communication layers (i.e. application 1 52, presentation 
154, session 156, transpoit 158. data link 162 and physical 164). Thus, by employing the 
Internet Protocol standard for the network layer 1 60, the home netwoik may use a 
combination of different communication layers in communicating between different home 
devices. It should be recognized that a single physical package may include several devices 
which are logically networked via a network layer for example as shown in FIG. 2, not 
necessarily via a physical networic Such devices may include a VCR and a TV in a single 
housing, for example. Thus, for such an embodiment, vdiere a logical device accesses a GUI 
to enable a user to control a home device, the home device and the logical device may be 
included m the same physical package. In such an embodiment, it could be considered that 
fhe physical device fetches a GUI fiom it5el£ However, in other embodiments the home 
netwoik interconnecte separate physical devices, wherein for example, a first device fetches a 
GUI fi^m a second device, to peixnit user interaction with the GUI to control the second 
device. 

By way of definition, it is contemplated that a "client" is a device piovidmg control 
interface service to a human operator, including a graphical display hardware for down 
communication and a mouse or other point-and-click device for up (or return) 
communication. A "server" is contemplated as a module supplying a service, which may be 
any scnrice other than a control interface provided by a client Stated differently, the 

-6- 



} 



00090000 (2496x3504x2 tiff) 



W098/S9283 PCT/IB98/0ni4 
server/client relationship is a control relationship, wherein the server provide^a service but a 
client may use the data, as a DTV displays video data, but does not manipulate or alter the 
data. It is thus consistent with this definition to observe that, frequently, a server nuy be a 
source of information and a client (a browser, for example) may be a consumer of 
i information. 

Some specific functions which may be implemented by servers include: return of 
information (data); performance of a function (e.g., mechanical function) and return of status; 
return of a data stream and status; recqition of a data stream and return of status; or saving of 
a state for subsequent action. Examples of servers include MPEG source, sink and dis|^ay 
10 servers. 

While a server typically includes a custom, built-in, control program to implement 
control of its own hardware, a client functions to interface with the server. It should be noted, 
however, that a "server** as used herein does not in^ly that a web server and a protocol stack 
must be used. 

IS In a presently preferred embodiment, a 1394 serial bus is used as the physical layer 

164 for the diata conununications on the home network 100. Because of its enhanced 
bandwidth c^abilities, iht 1394 serial bus can provide a single medium for all data 
communications on the home network 1 00 (i.e. audio/video streams and command/control). 
However, the home network 1 00 is not restricted to using a 1394 serial bus, and, in alternative 

20 embodiments of the present invention, other bus types, such as Ethemet, ATM, wireless, etc., 
may be used as &e physical layer if they meet the particular throughput requirements of an 
individual home network. 

As depicted in FIG. 1 , the home network 100 has several home devices connected to 
the 1394 serial bus 1 14. In this example, the home devices include a DBSS 104 which 

2S leceives transmission signals from a satellite 122 for subsequent display. Assodated with the 
DBSS is a network interface unit ("NIU") which, among other things, provides an interface 
between the DBSS satellite transmissions and the 1 394 serial bus 1 14. 

A digital video device ("DVD") 108 is also connected to the exemplary home network 
100. The DVD 108 can be used to display digitally encoded videos on a home television. 

30 Also cosmected to the exemplary home network 1 GO is a digital video cassette recorder 

("DVCR") 1 10, i.c., a digital VC^ and a digital TV 102. 

In this example, the DTV 102 provides the human intoface for the home network 100 
by employing browser technology to allow users to control and command the home devices 

-7- 
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over the home networic 1 00. Unlike most other home devices thai arc typicalty comiccted to a 
home network, the DTV 1 02 can provide the human interface for the home network 1 00 as it 
comprises a screen for displaying HTML pages. However other home devices having a 
display capability may be used to provide the human inter&ce. Thus, in certain embodiments 
5 of the inventions, a device such as a personal computer ("PC") is used to provide the human 
interface for a respective home network, as a PC typically embodies a screen display unit. 

Although the 1 3 94 serial bus 1 1 4 is depicted as using the HTTP/IP interface protocol, 
certun home devices may require other protocols inter&ce types (c,g. TCP/IP, UDP/IP, 
FTP/IP, TELNETAP. SNMP/IP, DNS/IP, SMTP/IP). Tlierefore the HTTP/IP protocol may 
10 not be able to satisfy ail home device connection requirements. Thus, in certain embodiments 
of the invention, a bridge proxy 1 1 6 is used to interface two netwoAs using dissimilar 
interfece protocols on their respective mediiuns which, when connected, comprise the home 
network 100. In certain embodiments, the two network mediums are of the same type. For 
example, as depicted in HG. 1. the 1394 serial bus 1 14 using the HTTP/IP interfece protocol 
13 is connected by a bridge proxy 116 to the 1394 serial bus 118. which uses the IEC61883 
interface protocol. By using bridge proxy 1 1 6 to interface between the HTTPiTP and 
IEC61883 protocols, security system 120, which uses the lEC 61883 interface protocol is also 
accessible on the home network 100. 

In certain other embodiments, a home network may be comprised of two network 
20 mediums of dissimilar types, e.g., a 1 394 Serial bus and Ethernet. Therefore, in certain 
embodiments of flw invention, a bridge proxy is used to interface two dissimilar medium 
types to form a single home network. 

The Dynamic Host Configuration Protocol (DHCP) server 106 is used for the 
discovery of home devices that are powered on and connected to the home network 100. The 
25 home device discovery process is described in greater detail below. 

HOME NETWORK OVERVIEW 

As depicted m FIG. 1, DTV 102, DVCR 1 10, DVD 108, DSS-NIU 104 and security 
system 120 represent home devices that are currently connected to the home network 1 00. A 
client-server relationship exists among 1he attached devices^ witi> the DTV 102 typicaUy 
30 behaving as the client and home devices DVCR 1 10, DVD 108. DSS-NIU 104 and security 
system 120 behaving as servers. 
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As previously mentioned, each home device is associated with one or thore Hypertext 
Markup Language (HTML) files. The HTML files define the control and command functions 
associated with a particular home device. Each HTML file may also contain embedded 
references to other HTML files. The browser based DTV 102 (acting as a client), receives 

5 and interprets the HTML files associated with the home devices (acting as servers) and 

graphically displays the respective control and command information on its viewable display. 

By confonning to the Hypeitext Markup Language (HTML) and Hypertext Transfer 
Protocol (HTTP) Internet standards, each home device sends its custom GUI to the browser 
based DTV 1 02. The browser based DTV 1 02 receives the HTML files from the home 

10 devices over the home network 100 using the HTTP protocol. Each HTML file contains 
specific control and command iikformation for a respective home device. The HTML files 
enable the browser based DTV 1 02 to graphically display control and command information 
to a user for a particular home device. Therefore, because each home device supplies its own 
GUI through its own HTML files to the browser based DTV 102, the browser based DTV 102 

\i can provide a command and control interface for a home device without having to know any 
specific details about the particular device. This fieature allows the home network 100 to 
contain home devices from a multitude of different manufacturers. 

In addition, home devices can be transparently added or removed fiom the home 
network 100 without affecting the overall system as, in accordance with the invention, each 

20 home device defines its own command and control interface through its respective HTML 
files. 

HTML TWO WAY MECHANISM 

FIG. 3 A depicts an exemplary embodiment in which a browser based DTV 202 
(client) renders the characteristics of a home device 204 (server) over a home network. The 

23 home device 204 is represented by one or more HTML files stored in an accessible area 
within the home device 204. The one or more HTML files are ASCII text files containing 
specific information pertaining to the particular home device 204, along with data that enables 
a browser to present the infonnation graphically. In addition to rendering the HTML file on 
the browser based DTV 202, by employing forms technology, the browser based DTV 202 

30 can return information back to the home de^ce 204, thus providing a two-way 

communication. Other common techniques for providing the two-way conununication may 
include the use of Java or Control Gate Interfaces (CGIs). Once the information contained in 
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a device's HTML file is graphically displayed on the DTV 202. the user can c6ntrol the home 
device 204 from the DTV 202 by selecting icons that have associated hyperlinks to start the 
control programs displayed on the DTVs screen and/or entering data to tiie DTV 202. 

HOME DEVICE HTML FILES 

5 As previously stated, each home device connected to the home network has one or 

more associated HTML files. The HTML files for a respective home device define &e 
control and command functions for that particular home device. Eadi HTML file may also 
contain embedded references to other related HTML files. A device connected to the home 
network that has a viewable display (e.g., screen) and employs the browser technology may 
10 receive and interpret the HTML files associated with the home devices connected to the home 
network, and gn^cally display die infoimation contaiiwd therein using a GUI on its screen. 

This is illustrated by FIG. 3 A wherein is shown an interaction between a client and a 
server's executables. However* it is a feature of the invention to provide control by 
interaction between cxecutables of two servers or of a client and plural servers. Thus, in 
15 accordance with the invention control is typically implemented by service control programs 
(executables which are trying to be operated remotely), communications, conunands and fif 
necessary), human interface with a server control program via a GUI. 

As one example, FIG. 3B shows location of file and program components locally, 
permitting control actions to be implemented by rurming programs and scripts on the device 
20 it5el£ This aspect of the invention thus permits implementation to be carried out in a local 
manner which may be proprietary to the device rather than being performed remotely, and 
which thus does not require a standardized 1394 command set. 

For example, the user may wish to change display brightness. To implement such a 
change, the user may click on a "Brigihtness'* button on tiie User HTML GUI page. In 
25 response, another GUI may be brou^t i^, with "Bright*" and "Dim- buttons. In response to 
the user clicking one of these two buttons, the http server will cause a brightness control 
program for the display to run, in order to control the desired hardware action. For action 
local to the DTV, the DTV thus may include a server capability, to interpret the post actions 
from the browser. 

30 In that regard, in order to be able to post actions to control their local hardware, all 

home network DTV devices preferably have a server capability. For such operation, a 
browser may pick up local html files and render the files to a GUI, without invoking the http 
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server. In order to invoke the local bttp server to respond, clicking on a button preferably 
involves an http access to the local m'»ri*'"'^ name or IP address. In turn, the http server 
invokes the local device control program, such as **Brigihtncss*' in the above example. 
Generally » control may be implemented by transfer of a graphical control object 
S (GCO), which preferably resides in the server, from the server for rendering on the client, to 
ywaifA xhe GUI. As an advantageous result of this approach, detailed controls bade to the 
server ori^nating the GCO may be proprietary, as the server device ^'understands" and is 
aware of its own GUI controls. Additionally, the look and feel of the GUI originates with the 
attached server (e.g., the program server, server device or media) and not with the client. 
10 Independence of the command language makes the arrangement operable independently of 
any new features added to devices, which may be included in the GCO sent from the server, 
as well as any other fUture modificadons, i.e., the home network configuration is made 
inherently "new-feature proof and **future proof". 

Moreover, because a specific device may be selected for control by selecting an icon, 
IS there is no need for hardware reconfiguration to implement control of different (or updated) 
devices. Accordingly, a single command set may be used in a ronote control for controlling 
plural (different) devices, by communicating with the client device rendering of the GUL 

For server to server control without a GUI and user involvement, automatic operation 
may be initiated or set-up by user control via a client, but later action is implemented by 
20 control language interaction between servers without involving a client 

In order to implement the foregoing, a server operating in accordance with the 
invention preferably has one or more control programs for executing a required service. The 
server, \**ich stores its GCO, provides the GCO to a client and a GUI rendered on the client 
interfaces vn&i the server control program(s) executable(s). Moreover, the server control 
25 program is able to save the state wluch has been controlled by the GUI. such as setting up a 
timer record action for example. The server also may include a clock for inqilementing 
various timer operations. The client is thus not required to have any knowledge of the server 
device being controlled, and it is not necessary to provide the client with the ability to save a 
previously controlled state. Indeed, as elsewhere described herein, the dient may not be 
yo running for part of the time in which the server is runnmg. Thus, preferably the server does 
not rely on another device, such as the client, for its operation and may serve multiple clients 
simultaneously. 
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A client, which receives GCO transfers fix>in one or more scxveis, incltides a GUI 
rendcrer to form the GUI from a received GCO. It is within the scope of the invention for a 
limited number of GCO's, for a limited number of servers, to reside in the client. However, 
for the inventive configuration of a home networic. the large number of different server types 
presently in existence and contemplated for the future demonstrates the advantage arising 
from the GCO's residing on the servers, thus freeing the client from a requirement for any 
built-in knowledge of the server(5) being controlled. 

In operation, during initial selection of the device, the GCO is fetched and rendered by 
the client, to form the GUI and enable actions and responses to be corxununicated between the 
GUI and the control program(s) of the client(s). 

For server-server control, a command language interface and library of commands 
may be provided in a server. For any individual server, it is not necessary to provide the 
entire command language. Instead, a server should only be able to support those commands 
v**ich it needs to send and receive to perform its functions. It is a simpler task to provide 
such a configuration than to build in the command language interface and library to a client 
for controlling all present and future servers. 

In addition to the one or more HTML files stored diercin, each home device connected 
to a home network contains a Properties file. In one embodiment, the Properties file for a 
respective home device comprises the device manufacturer's name, the device name, the 
device type, the device model, and the Uniform Resource Locator fURL") of the device 
manufecturw»s HTML home page. The top-lcvd page associated with each home device may 
be called the device/defaullHTML file. 

Each home device connected to the home network also contains a LOGO image file. 
A LOGO image file for a respective home device is a file containing an image diat represents 
the manufacturer of the device. In one embodiment, the LOGO image file for a paiticukr 
home device contains an image with the name and logo of die manufricturer of die home 
device. 

In the foUowing description, a software agent which assists the user in interacting with 
the network and controlling &e various home devices connected to the network, and thus acts 
as the primary inter&ce between the user and the home network, is caUed a session manager. 
For example, the software agent for the user (i.e.. the session manager) may access the 
devices to get more information for the user, in order to assist the user with making selections 
associated with the devices, or with managing the devices. Such assistance with control of a 
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device may include modifying the GUI display for that device, as by graying Out some 
buttons, thus inhibiting selection of various options (or devices) based on prior selections and 
capabilities of devices. Still further, the sesdon manager, acting as the user's agent, may link 
two or more devices selected by the user and may set up a communication path therebetween, 
freeing the user from the tedium and detail of implementing such control functions. 

In certain embodiments, in order for a session manager to properly locate the LOGO 
image file of a re^tective home device, all home devices connected to the home networic use a 
standard filename for the particular LOGO image file to be displayed. In one embodiment, 
each home device names its respective LOGO image file that is to be displayed LOGO.GIF. 

In certain embodiments, a LOGO image file for a respective home device is of a 
standard size, e.g. 120 x 40 pixels. A standard size ensures that the device logos have a neat, 
uniform look when depicted in the GUI displayed to the user. In certain embodiments, the 
image of the LOGO image file may also be animated. 

In certain embodiments, multiple versions of the LOGO image file may reside on a 
respective home device, with the home device responable for determining which version is 
ultimately displayed to the user. The home device may update the version to be displayed to 
the user over time, based on criteria of the device manufacturer's choosing. 

Each home device connected to a home network also contains an ICON image file. 
An ICON image file for a respective home device is a file containing an image that represents 
the particular type of home device; e.g.. a DTV or a DVCR. In certain embodiments, the 
ICON image file contains an image of the device or a symbol fliat represents the type of 
device. A manufacturer model number may be included at the bottom of the image in the 
ICON image file, to assist in identification of the home device on the home network. 

In certain embodiments, several variations of the ICON image file reside on a 
respective home device, with each ICON variation representing a particular state of the home 
device. For example, for a DVCR, the ICON image files may contain images of a DVCR 
pla^ng, rewinding, media inserted, media absent, etc. 

To represent the various device state images, the manufacturer may use a variety of 
symbols, colors and animation. The home device is responsible for determining which ICON 
image version is to be displayed to the user, based on Ae device's representative state at any 
particular time. This aUows the ICON image file for a respective home device to provide 
feedback to the user as to the particular state of the home device. 
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In ccrtwn embodiments, an ICON image file for a respective home device is of a 
standard size, e.g.., 120 x 90 pixels. A standard nze ensures that the device images will have 
a neat, unifonn look when depicted m the OUI displayed to the user. In one embodiment, in 
order for a session manager to properly locate the ICON image file of a respective home 
device to be displayed, all home devices connected to the home network use a standard ICON 
image filename for the respective ICON image file to be displayed. Each home device may 
name its respective ICON image file to be displayed ICON.GIF. 

As previously staled, each home device connected to the home network has one or 
more HTML files associated with it. One of these HTML files is a home, or base page, file 
for the particular home device. To aid in the access of a particular home device's home page, 
in certain embodiments, each home device uses a standard home page filename. In one 
embodiment, each home device names its respective home page file USER-HTML. 

HOME DEVICE DISCOVERY PROCESS 

Conununication on the home netwodc is provided through the use of the Transmission 
Control Protocol/fatemet Protocol (TCP/IP) standard network protocols. The TCP layer 
provides a reliable delivery mechanism while the IP layer provides a routable addressing 
mechanism for packets of data on the home network 100. In the home device discovery 
process, each home device is associated with a unique IP address and a logical name, which 
are used to identify a particular home device connected to the home network. To associate 
each home device witii a unique IP address and logical name pair, a configuration manager is 
provided tiiat dynamically aUocates a unique IP address and logical name for each home 
device that becomes available on tije home network. An available home device is a home 
device tiiat is botii powered-on aikd connected to tiie home networic. 

The IP address and logical name pairs of tiie available home devices are stored in a 
device list file wifliin the configuration manager. The device list file is dynamically updated 
as home devices are added and removed fiom the home network 100 (i.e., become available 
and non-available on the home network 100). 

By using the configuration manager to allocate unique IP addresses for each home 
device, device manufacturers are relieved from having to associate a predefined IP address 
with each home device. However, in certain embodiments of the invention, when a particular 
home device is associated with a predefined IP address, tiie configuration manager uses the 
predefined IP address as tiie home device's unique IP address on tiie home network 100. 
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In one embodiment of the invention, a dynamic host .configuration proCDCol C'DHCP'O 
server 106 of FIO. I performs &e functions of a configuration manager for a home network 
100. The DHCP is a current industry standard and, for a particular home network, multiple 
home devices may be capable of performing the necessary DHCP server 106 functions. 
However, although multiple home devices may be capable of functioning as the DHCP server 
106, In a presently prefeired embodiment, the home device that is of the device type least 
likely to be d\q)licated on the home network 1 00 (i.t., least likely to have more than one of its 
home device types resident on the home network 100) is nominated to function as the DHCP 
server 106. In the exemplary home network 100 of FIG. 1, the DSS 104 is nominated to be 
the DHCP server 106 for the home network 100 as it is least likely to be duplicated on the 
networic 100. 

The DHCP server 106 on the home network 100 generates a unique IP address and, 
for each home device that is available on the home network 100. retrieves a logical name pair 
from the device. In certain embodiments, if an individual home device on the home network 
100 has a predefined IP address already associated with it, the DHCP server 106 uses the 
predefined IP address as the unique IP address from that home device. The DHCP server 1 06 
causes the IP address and logical name pairs associated with the available home devices to be 
stored within a device list file. The device list file is dynamically updated as home devices 
are added and removed from the home netwoik 100. 

In certain configurations, a plurality of home devices with DHCP server ccq;>abilities 
may exist on a single home network. Therefore, in certain embodiments, an arbitration 
protocol is employed to select and designate a particular home device to function as the 
DHCP server for the home network. In another embodiment, a communication protocol is 
employed between the various home devices with DHCP server edibilities that are present 
on a home network, resulting in a single designated DHCP server for the home network. 

FIG. 4A is a block diagram illustrating a home device discovery process according to 
an embodimwit of the invention. When a home device 302 that is connected to the home 
network is powered on, the home device 302 broadcasts its presence over the home network 
in order to extract its configuration from the DHCP server 306. Upon receiving the broadcast, 
the DHCP server 306 generates a unique IP address and a lo^cal name to be associated with 
the home device 302. After generating the unique IP address and looking up the logical name 
pair, the DHCP server 306 returns the IP address and logical name pair to the home device 
302. The unique IP address is then used for communicating with the home deyicc 302 over 
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the home network. In addition to sending the IP address and logical name paif to the home 
device 302. the DHCP server 306 stores the generated IP address and logical name pair within 
the device list file. This discovery process is repeated for eadi home device that is powered 
on and connected to the home network. Thus, the DHCP server 306 provides for the dynamic 
5 allocation of IP address and logical name pairs for configuring newly attached and powered 
on home devices. 

FIG. 3A depicts a flow diagram illustrating the generation of a device list file 3 1 g 
according to certain embodiments of the invention. In this example, a DHCP Server 310 
communicates with a home device 312 that is accessible on the home network in order to 

10 generate a unique IP address and logical name for the home device 312. Tte DHCP Server 
3 1 0 stores this information in the DHCP database 3 14. As home devices become 
available/non-available on the home networic, the information in the DHCP database 3 14 is 
continually updated in the manner described below. 

GENIP is a Win32 console-based application which interacts with external programs, 

1 5 databases (indirectly) and device/session managers. Hie core interaction is an indirect contact 
with the standard DHCP Server product which is part of the standard Windows NT Server 
package, through a program known as DHCPCMD.exe, Mduch is part of the NT Server 
Resource kit found on MSDN developer DCROM sets. In operation DHCPCMD.exe 
interacts with the external programs and databases via a command "enumclients". which 

20 creates a listing of ail tiie cutxent database of DHCP clients. Thus, GENIP runs the 

DHCPCMD titility and generates an internal "current" database of IP leases active in the 
DHCP database from the output of the DHCPCMD utility. 

The GENIP process 316 of FIG. 4B periodically reads the device information 
contained in the DHCP database 314 and compares it with the device information currently 

25 contained in the device list file 318. By comparing the information the GENIP 3 16 can 
determine if a home device has been added or removed from the home network. More 
specifically, the "currenf database is compared itcm-for-item against the previously read 
database and, if any differences ate found, a database update is performed thereby providing 
detection of any newly connected devices on the home network. 

30 In one embodiment, if the device infomiation contained in the DHCP database 314 

differs from the device information contained in the device list file 3 1 8, the GENIP process 
3 1 6 signals a process to update a device link page and rq»int a client displj^. The device 
Imk page is described in greater detail below. 
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ReadDHCPDBO is the woikhorse of GENIP, handling the setup and execution of 
DHCPCMD as well s reading the resultant oxapux therefrom, reading the same into the 
"cunent" database, comparing with the ''previous** database, and then writing a new "output** 
database for the clients. 

By default, GEKIP operates on the DHCP database every 3 seconds, and it is thus 
advanlageotis to have GENIP nmning on the same physical machine as the DHCP server 
itsel£ Similarly, as the de^ce and/or session managers will be accessing the output database 
frequently as well, the output file should be placed in a directory which is shared-out by the 
server and to which the clients have access. Although this requires agreement by the clients 
on where the output database is stored, this feature of the protocol may be improved upon by 
providing a protocol v^ch both is non-polling for the events and also does not require 
manual configuration. 

For example, instead of writing to a file, the UpdateDBQ member of GENIP may 
prepare a network packet which could be broadcast into the subnet of interest, the packet 
contuning instructions for the client on how and where to get the latest database informatiorL 
This may be simply implemented by using the http protocol, placed on an tmused pott such as 
8080 for example, so that the broadcast message would contain 

http://scrverjp_address:8080/networkjdb.txt The "netwoik_db.txt" portion of the message 
would not be used if the only use for port 8080 is the network database. For improved future 
capability and expansion purposes, other infoimation would be allowed to be transmitted via 
this same hvtp port, and an actual full URL is provided. 

AUro-TREE BUILDER 

In one embodiment of the invention, an auto-tree builder uses the contents of the 
device list file of a home network in order to generate a device link page. The device link 
page is displayed to the user on the screen of a browser based home device. The device link 
page contains a home device button for each home device identified in the device list file. 
Each home device button in the device link page is associated with a hypertext link 
fllYgTr?T*'V> to the top-level page of the respective home device. If a user selects a particular 
home device button contained in the device link page, the respective device's home page is 
subsequently displayed to the user on the browser based home device's screen. 

FIG. 5B illustrates an example of a home device tree structure 400 according to certain 
embodiments of the inventioiL In this example, the home device tree structure 400 contains a 
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device list file 410, a device link page 412 and three top-level device pages (DSS 414, DTV 
416 and DVD 418). Using the device information contained in device list file 410. the auto- 
tree builder generates the device link page 412 and inserts links (c.g, hypertext links) to the 
top-lcvcl page of each device (DSS 414. DTV 416 and DVD 418). In this example, the 
5 device page DSS contains several data files 420 that can be accessed via the link between the 
device link page 412 and iht DSS top-level device page 414. 

hx certain embodiments, in generating the device link page, the auto-trcc builder uses 
the device list file to create a device HTML file that contains a home device button for each 
home device that is currently connected to the home network. Using the IP addresses 

10 contained in the device list file, the auto-tree builder accesses each home device to obtain the 
Properties file information and the URL of the top-level page (i.e. USER.HTML file) 
associated with each home device. Using the respective URL information, Ae auto-tree 
builder converts each home device button in the device HTML file to a hypcr-tcxt link to the 
top-level page of the respective home device. This device HTML file is then used as the 

IS device link page. 

For example, FIG. 5 A is a device link page 402 according to one embodiment of the 
invention. As depicted, device link page 402 contains home device buttons 406 for each 
home device connected to the home network 100. Each home device button 406 is associated 
with a hypertext link to the top-lcvcl home page of the corresponding home device. If a user 

20 selects a particular home device button 406 contained in the device link page 402, the 
respective device's home page is subsequently di^iayed to the user. 

In certain embodiments of the invention, the auto-tree builder also retrieves the 
ICON.GIF image file that is stored in each home device. The auto-tree builder then tises the 
ICON.GIF images for displaying each of the corresponding home device buttons. 

25 In addition to the ICON inuiges, in certain embodiments, the auto-tree builder also 

obtains the LOGO.GIF image file for each home device. The auto-tree builder associates 
each LOGO.GIF image with a hypertext link to the home page of the device's manufacturer. 
The LOGO image is then included in the device HTML file. For example, FIG. 6 is a device 
link page 502 according to one embodiment of the invention. As depicted, the device link 

30 page 502 contains home device buttons 504 and manufacturer device buttons 506. The home 
device buttons 504 arc represented by the ICON.GIF images of each corresponding device. 
The manufacturer device buttons 506 are represented by fiie LOGO.GIF images of the 
respective manuf a cturer of the conresponding home device. 
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Is certain embodiments, as depicted in FIG. 7, the user may define th^Unangement of 
device images 602 and logos 604 on the device link page 606, according to his or her own 
criteria. For example, a user may arrange the device images 602 and associated logos 604 in 
groups according to the respective home device's placement in the home, e.g., on a room by 
room basis. In such an example, a camcorder manu&ctured by SONY, a DTV manufactured 
by Samsung and a DBSS manufactured by Zenith may all be grouped in a living room group 
608. In this embodiment, the user may also include additional text lines 610 to describe the 
groupings and/or the deWces depicted by the device images 602 and associated logos 604. 

SESSION MANAGER 

As previously noted, a session manager provides the prixnaiy interface between a user 
and a home netwoik. The session manager, vihexi properly activated, generates a session page 
that provides an interface which allows users to command and control the home devices that 
are connected to the home network in order to perform various functions and/or services. 
Some typical services that are available on a home network include, but are not limited to, 
stMt^pg a movie playing, programming a DBSS, and recording a television program. 

The session manager displays avulable home network services (servers) and matches 
capabilities and selections made in one graphic user inter&ce (GUI) with another GUI to 
facilitate sensible and easy selection, thus simplifying use of the home networlc. 

FIG. 9 is a block diagram illustrating a session manager 750 causing two home 
devices (DTV 752, DVCR 754) to communicate over a home network according to certain 
embodiments of the invention. As depicted in this example, by sending command and 
control information to the home devices (DTV 752, DVCR 754), the session manager 750 
causes the home devices (DTV 752, DVCR 754) to communicate with each other (i.e. 
audio/video stream). For example, to display a recorded TV show, the session manager 750 
ff ffn dff command/control information to cause the DVCR 754 to broadcast information (e.g. 
the TV show) on a particular stream over the home network. In addition, the session manager 
750 sends command/control information to cause the DTV 752 to display the information that 
is being broadcast on the particular stream over the home network. 

Similarly, thoufi^ not shown in the drawing Figure, the session manager may send 
command/control information to cause a tuner (for example the DBSS) to broadcast a TV 
show on a stream over the networit and may send further command/control information to 
eittier or both the DTV and DVCR to display and/or record the TV show. 
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In still another alternate embodiment, if a single physical housing, or package, were to 
include both a DTV and a tuner (i.e., two separate logical devices), the command/control 
information sent to the housing would cause the tuner therein to broadcast a TV program on a 
stream over the home network to either (or both) tiie DTV in the same housing and/or to the 
separately housed DVCR. 

More specifically, client/server control actions may be implemented to initiate an AJW 
program source stream and a sink sender stream. Once data is flowing, the session manager 
client may disengage from tfab activity and perfom other functions. In controlling the 
illustrative configuration, the session manager may cause the DVCR 754 to save a first state, 
e.g., "timer record'*, and the DTV to save a second state, e.g., 'Himer select a program". A 
clock later triggers the saved states into action. In this example, no further control actions are 
required of the session manager. However, for more complex examples, the session manager 
may remain in, or regain, control, or may initiate further control of other devices. 

Although the basic model illustrated in FIG. 9 shows one client and two servers, one 
server representing the control program controlling the DTV as providing a display service 
and the other representing the control program controlling the DVCR to provide a recording 
service, the model can be extended to a plurality of N servers where N > 2. 

FIG. t illustrates a session page 702 according to one embodiment of the invention. 
In this example, the session page 702 contains frames 704, 706 and 708, As depicted, frame 
704 contains a device link page 710 that contains device buttons 712 for each home device 
currently connected to the home network. 

When the session manager is activated, it causes the auto-tree builder process to 
generate a new device link page. In certain embodiments, the session manager is notified as 
home devices are dynamically added and removed from the home networlc For example, 
referring back to HO. 4B, when Oie GENIP process 316 determines that a home device has 
been either added to or removed from the home network, the GENIP pn>cess 3 1 6 notifies the 
session manager. The session manger then causes the auto-tree builder process to generate a 
new device link page. 

In an alternative embodiment, the session manager periodically polls the device list 
file 3 1 8 to determine if it has been updated with new home device information. If the session 
manger determines that device list file 318 has been updated, the session manager causes the 
auto-tree builder process to generate a new device link page. 
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In ccftain embodiments of the invention, the auto-tree builder process functions are 
conftained willun the session manager. Thus, in one embodiment of the invention, the session 
manager generates the device link page by peifonning the previously described auto-tree 
builder fimctions. 

s A critical function of the session manager is to enable a user to initiate an available 

service on the home network. An available service is a particular function that can be 
performed by one or more home devices diat are currendy powered-on and connected to the 
home network. For example, a service may consist of selecting a DTV for viewing a 
pazticular TV show and tuning the DBSS to a particular station that is carrying the respective 

to TV show. 

To enable a user to initiate an available service, when the user selects a particular 
home device button 712 from the device link page 710» the session manger causes the top- 
level home page of the selected home device to be displayed within a frame contained in 
session page 702. For purposes of explanation, it shall be assumed that a user selects the 

IS device button 712 corresponding to "Dad's TV*. 

As shown in FIO. 10, when the user selects the device button 712 for Dad's TV, the 
session manager displays the top-level home page 804 for the re^ective home device in a 
frame 706 of the session page 802. FIG. 10 is similar to FIG. 8 and, therefore, like 
components have been numbered alike. As depicted in FIO. 10, in certain embodiments of 

20 the invention, the LOGO image 806 that is associated with the selected home device is 
di^layed within frame 706. 

After a device image 712 is selected, the session manager continues to display the 
contents of the device link page 710. However, in certain embodiments, the selected device 
button 712 is deactivated and is, therefore, non-responsive for further selection by the user. 

25 For example* when the device button 712 corresponding to Dad's TV is selected, it is 
deactivated and becomes non-responsive to further selection by the user. 

When the user selects a home device button 712, the session manager obtains the 
particular capabilities of the selected home device. The particular c^abilities of a home 
device includes a list of standard named functions that the respective home device is capable 

30 of perfonning, e.g., the capabilities of a DVCR generally include '^accepting video" and 
••displaying video**. 

In certain embodiments, the session manager obtains the particular capabilities of a 
selected home device by accessing a standard named file on the respective home device. 
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After obtaining the particular c^abilities of the selected home device, the session 
manager searches the capabilities of the other home devices that are represented in the device 
link page 710 (i.e., listed in the device list file), for matches to the particular capabiUties of the 
selected home device. For each home device found to have a mftfehing c^>ability to Ac 
selected home device, tiie session manager continues to activate the respective device button 
712 (i.e.. maintains it responsive to selection by the user). For each home device that is found 
to have no matching capabilities to the selected home device, the session manager deactivates 
the respective device button 712 (i.e., sets it non-responsive to selection by the user) in order 
that the user may not further select the respective device for the current session. 

For example, w^ere the user has selected a client device such as a TV display, the 
session manager may specifically search for matching devices which arc capable of acting as 
video servers, or sources, rather than for other displays. Under such circumstances, the 
session manager may deactivate buttons for o&er displays. Alternatively, in a "control only" 
mode of operation, where a server-client relationship is not being established, the session 
manager does not seek a second device which may act as a source for the selected device. 
More particularly, in accordance with the invention it is possible to operate with a 
number of software agents representing devices which are capable of controlling lights, for 
example. In such an environment, the user would select both a control device, vfbich is not a 
source or server of information, and one or more light devices to be controlled thereby. When 
the user first selects the control device, the session manager may then identify various devices 
capable of being controlled by. or interacting with, the selected device and continue to 
activate tfie respective device buttons thmof. v/bilt deactivating the buttons for other devices. 
Indeed, it should be appreciated that the session manager may select any number of devices 
for presentation to the user as possible choices for operation, for which the selection buttons 
remain activated. The devices may or may not co-operate with each other. That is, the 
devices vfhosc buttons remain activated may operate in cooperation wiA. or independently of, 
each other. 

Where an information presentation device is selected, it may be possible Aat a 
plurality of servers may remain active for possible selectioa For example, in accordance with 
some embodiments of the invention, when a device button for a DTV or DVCR is selected, 
the session manager may activate device buttons for several infomiation sources, such as an 
audio server and a video server. Indeed, it is also possible that device selection buttons may 
remain activated for selection of plural video servers, and ^t upon selection of one video 
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server the buttons for selection of other servers will be maintained acUvated, tb account for 
sttuatioDS wherein it is desired to provide multiple images on a single display. For example, it 
may be desirable to display an entertainment video while amultaneously displaying, as a 
pictuie-in-a-piduie, ^ddeo from a security camera or from another server. Alternatively, 
5 video Informadon from one or more sources may be eonununicated to a plurality of client 
displays. 

It shotild thus be appreciated that, as appropriate information on capabilities of device 
interaction is provided to &e session manager, the session manager will indicate that various 
of the devices are, or are not, enabled for selection by the user based on the user*s prior 
10 selections. By acting as an agent for the user, the session manager obtains information 
relating to device capability and, in response thereto, deactivates selection buttons for 
particular devices while maintaining active the device selection buttons for other devices. By 
determining whetho' and which devices have matdung capabilities, and by graying out 
(deactivating) buttons for non matching devices and activating buttons for matching devices, 
IS the session manager th\is assists the user with nudcing selections associated with the devices, 
or with maruiging the devices. 

With such assistance, the user may then selea a second home device to interact with 
the previously selected home device in order to perform the desired service. Where the 
session manager has inhibited some selection possibilities and enabled others, the user*s 
20 selection is simplified. Where the matching, selection, inhibiting or enabling has not been 
carried out by the session manager, the \iser performs the selection based on various criteria. 
For example, the user may simply ^sh to select or activate a specific device. Alternatively, 
the user may wish to select all devices enable of performing a specific function. 

In that regard, the session manager may generate a page which includes all contents of 
25 the network, and all functional capabilities, independent of specific deidcc Thus, the HTML 
page may Identify services available to the user by content, such as by providing a list of 
video or audio programs, etc., which arc available on the home network regardless of the 
device on which such content is being provided. Such a display is user transparent in the 
sense that the user is permitted to select information sources based on content, rather than 
30 equipment, device or channel trough which the infoimaticm is made available. 

On selecting the second home device, the sesdon manager displays the home page for 
the second home device in frame 708. The order in v/bich frames are chosen for displaying 
the home page of each selected device is not critical, and therefore, in certain embodiments of 
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the invention, the home page of the first selected device is displayed in frame 908 and the 
home page of the second selected device is displayed in frame 706. 

FIG. ] 1 illustrates session page 902 after the selection of a second home device 
according to one embodiment of the invention. As shown in FIG. 1 1 , when the user selects 
the device button 712 corresponding to Jim's DVD in this example, the session manager 
displays the top-level home page 904 for the respective home device in a &3mt 708 of the 
session page 902. FIG. 1 1 is similar to FIG. 9 and FIG. 10 and, therefore, like components 
have been numbered alike. As depicted in FIG. 1 1, in certain embodiments of the invention, 
the LOGO image 906 associated with the selected home device is displayed within the frame 
708. 

Once two home device images have been selected, the session manager allows the 
respective home devices to communicate with eadi other to set iq) and perform the deared 
service as selected by tbc user through the options displayed on the respective home pages 
804 and 904 of each selected home device. 

An example of an embodiment of a session manager session 1002 is displayed in 
FIGS. 12A, 12B and 13. In this example, as depicted in FIG. 12A, the user may choose one 
of four device images displayed in a device link page 1022 contained in frame 1004 of a 
session pagel 01 2. In this example, the user may select a DSS device button 1014, a CD 
device button 1016, a DTV device button 1018 or a DVCR device button 1020. For 
explanation purposes, it shall be assumed that the user selected the DVCR device button 
1020. 

As depicted in FIG. 12B, v/hca tiie DVCR device button 1020 is selected, the session 
manager displays the home page for the respective DVCR in frame 1006 of the session page 
1012. The session manager continues to display the four device images in the device link 
page 1022 of tiie session page 1012. After the user selects the DVCR device button 1 020. the 
session manager determines tiie particular ciq)abilities of the selected DVCR device and 
compares them with the particular capabOities of the otiier accessible devices on the home 
network, i.e., the DBSS, the CD and the DTV. 

In this example, the session manager determines that there is a match in capabilities 
between the selected DVCR and both tiie DTV and die DBSS. Tbe session manager also 
determines that there is not a matdi between the capabilities of the selected DVCR and the 
capabilities of the CD. Thus, the session manager deactivates die device button 1016 for tiie 
CD in the device link page 1022. Additionally, because the DVCR device button 1020 was 
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selected by the user, the session manager now deactivates the DVCR device b^itton 1020 on 
the device link page 1022. 

Because the session manager found matching capabilities between the selected DVCR 
and the DBSS and the DTV devices connected to the home network, the session manager 
s continues to keep the device buttons 1014 and 1018 active for these respective home devices 
in the device link page 1022. Therefore, in this particular example, the user may now 
additionally select either the DTV device button 1018 or the DSS device button 1 014 in order 
that the selected respective device may interact with the previously selected DVCR to perform 
a particular service on the home network. However, because the CD device button 1 01 6 has 
10 been deactivated, as there are no shared capabilities between the CD and the previously 
selected DVCR* the user may not select the CD device button 1016 at this time. 

In thb example, the user additionally selects the DTV button 1018 contained in the 
device link page 1022. 

As depicted in FIG. 13, the session manager then displays the home page for the 
IS respective DTV in frame 1008 of the session page 1012. The session manager continues to 
display the DVCR device's home page in frame 1006 and the four device buttons 1 014, 1016, 
1018 and 1020 in the device link page 1022 of the session page 1012. The user may now 
select control options from the home pages of each selected device (e.g., play 1044 and 
volume 1042 respectively from the DVCR and the DTV home pages) in order to command 
20 and control the respective home devices to function in a particular manner. 

Any home deviee connected to a home network that can act as a client, i.e., ^^ch has 
the capability to display HTML files via is respective display unit (eg., a DTV or a PC), may 
be designated a session server. A session server is a device that contains a session nuinager, a 
display imit (i.e., screen), iu own HTML page files, including a top-level, home HTML page 
2S file, and a browser. 

In certain embodiments, when a session server (e.g., a DTV, general purpose 
computer) powers iq), the associated session manager is executed and a session page, as 
discussed previously in FIO. 12A, is displayed on the display unit of the particular session 
server. The user may then select a home device to command in order to perform a desired 
30 function or service. 

In an alternative embodiment, when a session server powers up, its respective browser 
runs and displays the top-level home page for the respective session server. In certain 
embodiments, the session server's home page is associated with a standard filename, such as 
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USER.HTML. Associated with the session server's home page is a device page button option 
which, when selected, causes the session manager executing on the session server lo display a 
session page as discussed previously in FIG. 12A. 

EXECUTING A SERVICE 

5 As previously indicated, the session manager is the primary interface between the user 

and a home network. It is a tool capable of accessing and controlling every home device on 
the networic, and, generally, should be available on every browser-based home, i.e., client, 
device. 

The session manager enables a user to begin a service on the home network. As 
10 previously discussed, in relation to FIGS. 12A, 12B and 13, a session manager allows an user 
to dioose up to two home devices at one time, vMch he or she widies to control to perform a 
specific service. 

Each home device possesses one or more capabilities. For example, a D VCR is 
capable of both accepting and ou^utting a video signal, a CD player is capable outputting an 

ts audio signal, and a DTV is capable accepting video signal. Capabilities are either source-like 
or sink-like. A CD player posses a source-like capability as it is cqsable of ou^utting an 
audio signal. In contrast, a DVCR possess both source-like and sink-like capabilities as it can 
accept and output a video signal. 

Each sotirce-like capability has a complementing sink-like capability that is 

20 compatible with it For example, the outputting video capability of one home device is 

complemented by the accepting video capability of a second home device. Each capability is 
associated with a certain set of data specifications. For example, when a DVCR outputs a 
video signal, the video signal is broadcast on a particular stream of the over the home 
netwoik. The stream number and other information about the signal form part of the DVCR's 

2S (outputting home device) data specification message. Therefore, in one embodiment, to 
execute a session, a first home device (ou^utting home de^ce) communicates a data 
specification message to a second home device (acc^ting home device) via the session 
manager. 

To provide for home device communication, each home device has a control 
30 application associated with it The control application for a home device handles the 

communication between the session manager of the respective home network and the home 
device. Therefore, the control application for two respective home devices, provides a 
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mechanism that allows two home devices to communicate with each other via*1he control 
manager. In certain embodiments, the control application is a device*specific packet of Java 
code that communicates with the hardware of the respective home device, thereby controlling 
that home device. 

5 By having a control application associated with each home device on the home 

network, the control implementation details of the respective home device are grouped and 
maintain?<> within a vendor-supplied device application. The control application of a home 
device further enables the respective vendors to provide their own control scenarios for their 
devices. All of the control applications of the home devices on the home network, however, 

10 must comply with certain pre-defined specifications in order to enable a respective home 
device to communicate with the session manager. 

In certain embodiments, each home device on the home network has a list of data 
specifications associated with it For example, a DVCR that has been instructed to "Output 
Video", i.e., transmit a video signal, broadcasts the video signal on a particular isochronous 

IS stream. The stream identification information and other details about the video signal form 
part of the data q>edficatioiis for the DVCR. The control application of a home device, e.g., a 
DVCR. is capable of storing and advertising the home device's data specifications when 
queried by the session manager. 

As previously discussed, the session manager can query various home devices for 

7Q their particular capabilities. The session manager is also responsible for querying various 
home devices for their data specifications, in order to ensure the requested user service is 
property established and pcrfoimed. 

Once a user selects two home devices to perform a partic\ilar service, the user must 
choose certain device options for each of the selected home devices to perform that particular 

25 service. By choosing various device options, the respective device's hardware is initialized to 
perform the service. Hie session manager coordinates iht conununication between the 
selected devices to establish their hardware configurations and to perform the requested 
service. 

As an example, referring again to FIG. 1 3, if a user wishes to play a video on the 
30 DTV, the service wiU consist of the playing of a video in the DVCR and the displaying of the 
respective video on the DTV. After the user selects the PLAY conunand option on the 
DVCR, the DVCR, among other tasks, chooses the isochronous stream that the video signal 
will be broadcast on. This information, as well as other pertinent information regarding the 
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signal to be broadcast and the particular DVCR hardware setup for broadcasting, i.e., the data 
specifications of the DVCR for the PLAY service, are subsequently forwarded to the session 
manager. 

The session manager, ^xpoTi receiving the data specifications from the DVCR« forwards 
the information to the DTV, in order tiiat the DTV may properly initialize its hardware to 
display the video signal broadcast by the DVCR, Some time thereafter, the session manager 
deletes the session page 1012 from the DTV display screen, allowing the DTV to display the 
video broadcast by the DVCR. 

EXTERNAL CONNECTION 

Because the home network is Internet protocol compatible, connecting the home 
network to the Internet can provide the advantage of being able to control home devices frt)m 
outside the home. Therefore, in certain embodiments of the invention, a connection is 
provided which allows the home network to interface with the Internet. FIG. 14 depicts a 
home network 1 100 connected to the Internet 1 102 in accordance with the present invention. 
Because many of the components in FIG. 14 are similar to FIG. 1, like components are 
numbered alike. 

As depicted in FIG. 14, in certain embodiments an Internet proxy 1 104 is used to 
provide an interface between the home network 1 1 00 and the Internet 1 1 02. By providing an 
interface between the home network 1 100 and the Internet 1 102 a user can remotely control 
home devices cormected to the home network 1 100. For example, if a tiser is required to 
work late and is therefore unable to watch the Monday night football game, the user can 
program a DVCR connected to their home network ida the Internet, in order to record the 
particular event 

Coimecting the home network to the Internet can induce potential security access 
issues. Therefore, in certain embodiments, a security mechanism is associated vnih the home 
network that is used to restrict access to die home network to particular authorized users. 

MACROS 

As described above, a user must typically perform a sequence of steps in order to 
cause a home device to execute a particular service. In addition, because users of a home 
network typically have dissimilar preferences as to the particular settings of certain home 
devices, a sequence of steps may be repeatedly performed in order to adjust the settings of a 
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respective home device. For example, a first user may have a particular preference as to the 
brightness, tint and/or contrast of a particular DTV, while a second user has different 
preferences. To reduce the number of repeated steps typically perfonned by a user to set the 
settings of a pazticular home device, in certain embodiments of the invention a sequence of 

$ steps can be saved as a macro. 

A macro is a sequence of commands that is saved in memory on a home device and 
which can be accessed and executed by a user. The macro executes as if the user actually 
selected a particular button or performed a particular action from within a HTML page 
contained on the respective home device. 

10 The use of macros can significantly reduce the amount of work that is required by a 

user to perform a particular function as a single macro can be used to facilitate the convenient 
setup and control of several devices in tandem. For example, a user may want to record a 
particular TV program on channel 2 at 8:00 pjn. for 1 hour every Tuesday night. This 
normally requires the user to select a DBSS or DTV as the source of the program and to enter 

IS a particular sequence of steps to program a DVCR to receive and record the program. 
However, using a macro, the user need only perform the step of executing the particular 
macro. The macro then executes the necessary stqps of selecting and commanding the 
particular devices in order to record tiie program. 

There are multiple ways of generating macros depending on the particular respective 

20 home devices' software capabilities and the implementation of their HTML pages. In certain 
embodiments of the invention a preset type of macro is used which saves the actual values of 
a device's parameters. The preset type of macro can be used in a home network in which the 
parameter values of a particular home device can be quoied and set. The preset macro is 
created by saving the current value of a particular set of home device parameters. Each macro 

25 is associated with a name so that it can be easily retrieved and executed at a later time. When 
a macro is subsequently executed it issues the appropriate commands to set the chosen 
parameters of the respective home device to their assigned value. 

For example, FIG. IS depicts the creation of a preset macro 1200 according to one 
embodiment of the invention. As depicted in FIG, 1 5, vAien a create macro button 1202 on a 

30 respective HTML page of a home device is selected, a macro generation process 1204 begins 
to execute. Execution of ^ macro generation process 1204 causes a set of user selected 
device parameter values 1208, selected from the home device's parameter list 1206, to be 
saved to a macro file 1210. The macro file 1210 is assigned a unique macro name 1212 and 
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saved on the home device. The macro name 1212 is saved as a macro name button on the 
home device's macro list HTML page 1214. Thereafter, a user may select the macro name 
button, causing the respective macro file 1210 to be executed. 

In one embodiment of the invmtion, a macro button is included on a respective home 

5 device's HTML home page. Selecting the macro button causes the macro list HTML page 
1214 to be displayed to the user. In one embodiment, the create macro button 1202 is 
contained on the macro list HTML page 1214 for a respective home device. 

In an alternative embodiment, a player piano macro is created by a home device's 
software and/or hardware saving the particular steps taken by a user while interacting with the 

10 device's HTML pages (e.g., the user's button selections, data entries and/or cursor movements 
are saved as they are executed by the user). Again, the created macros are associated with a 
particular name so that they may be easily retrieved and executed at a later time. When the 
player piano macro executes, it performs the particular sequence of instructions as if the user 
was accessing the re^>ective home device HTML page(s) and executing the sequence of steps 

15 directly. 

For example, FIG. 16 depicts the creation of a player piano macro 1300 according to 
one embodiment of the invention. As depicted in FIG. 16, vvlien a create macro button 1 302 
is selected a macro generation process 1304 begins to execute. Execution of the macro 
generation process 1304 causes a user interaction 1306 to be inteipretcd as a particular action 

20 by a conmiand intcipretCT 1308. The respective actions are copied into a macro file 1310, 
which is saved on the respective home device and assigned a unique macro name 1312. The 
macro name 13 12 is saved as a macro name button on the home device's macro list HTML 
page 1314. Thereafter, a user may select the macro name button, causing the respective 
macro file 13 1 0 to be executed. 

25 In addition to the user created macros, in certain embodiments of the invention, a 

predefined set of macros are stored in the respective home device's memory for access by a 
user. Because macros are typically device dependent, in ceitun embodiments of the invention 
the m a nu facturer of a particular home device creates and defines a set of macros that can be 
executed on the respective home device. 

30 HOME NETWORK PROGRAM GUIDE 

To provide a user witii a list of available multi-media material (e.g., audio and video 
programs, TV programs, and CDs), one or more home network program guides are associated 

'20- 



00330000 (2496x3504x2 tiff) 

WO 98/59283 PCT/IB98/0ni4 

with a home network. The one or more home network programming guides xnay be 
categorized as to the available multi-media material on a particular home device or may be 
combined in various ways to dcpioX a particular groi:^ of accessible muhi-media material. 
A television programming guide typically provides a list and schedule of programs 

s that are available for viewing on a particular channel. Most digital satellite services provide 
programming infonnation through an Electronic Programming Guide (EPG). The EPO 
displays a list of available programs and the specific time in which the programs can be 
viewed through the service. The EPGs are continually updated to reflect a current window of 
available programs. Tlie home network uses the EPG infomiation to build a home network 

10 HTML program guide. The HTML program guide is developed using the HTML standards 
and can be displayed on a browser based home device. In addition, users can customize the 
particular programming information that is displayed. For example, if a user would prefer not 
to display the schedule for a particular channel, e.g., because of its prognunming contents, the 
user may request that channel be removed from the HTML program guide. 

IS The infonnadon contained in an EPG is dependent on the particular DBSS that is 

used, and as such, there is currently no standard format for transmitting this information. 
Therefore, in one embodiment of the invention, a process extracts the information from a 
particular EPG and converts it into a standard program format The standard program format 
is then used to build an HTML program guide. The HTML program guide can be displayed 

20 on any browser based home device (e.g., a DTV or a PC). Like the EPGs. the HTML 

program guide is periodically updated to reflect the currently available programs. As stated 
above, the user can customize the displayed HTML program guide to view only a particular 
set of the available information. 

If an EPG format standard is developed, the HTML program guide can be built 

2S without frist converting the EPG infonnation into the standard program format Therefore, in 
certain embodiments of the invention, the HTML programming guide is buih using a standard 
EPG fonnat as transmitted by a particular DBSS. 

In addition to the EPG received on a DBSS, the home network can be associated with 
other home devices that contain multi-media material. For example, a DVD may contain 

30 certain movies, a PC may contain specific files (e.g., games, picture images), a DVCR may 
contain a particular movie, and a CD player may contain specific CDs. In certain 
embodiments, each home device mwn^qinff an HTML program guide file that contains a list of 
the material currently available on the respective home device. Using a browser based home 
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device, a user can display the available material on a particular home device by rendering the 
particular home device's HTML program guide file. 

In certain other embodiments of the invention* a multi-media identification process is 
tasked with searching the accessible home deuces to determine what material is currenily 
available on each of tiiem. In one embodiment, the multi-media identification process 
accesses each home device to obtain a file or directory that contains a list of the available 
material on. the particular home device. A home device contents process then creates one or 
more HTML program guide files that depict the material currently available to the user. A 
user can display the available material by rendering a particular HTML program guide file. 

In an altemative embodiment, the multi-media identification process obtains the 
HTML program guide file that is maintained on a respective home device. Using the HTML 
program guide files obtained from the particular home devices of the home network, the 
multi-media identification process creates one or more HTML program guide files that depict 
the material ctirrentiy available to the user. A user can display the available material by 
rendering a particular HTML program guide file. 

CONCLUSION 

In accordance with the described invention, control of a plurality of devices (for 
example, a VCR. a CD player, a DVD player or any other device) is implemented with the aid 
of a single control loop, established from a video display of a client device (such as a TV or a 
PC) to a user, to a remote control device, to a detector (such as an IR detector) on the client 
device. Such a control loop is usable for controlling the phirality of devices, thereby 
eliminating a requirement for front panel controls on such devices. In one form of the 
invention, the control loop may be inqjlemented by connecting the devices to a home 
network. Instead of using traditional front panel controls, the invention tiius provides for 
control of such devices through the home networic by interaction vwth the respective GUI 
thereof as rendered on the client device. The invention also elinunates a requirement for a 
remote control device to include therein, or to have access to, control codes specific to each of 
the devices on the network. In the illustrative embodiment described herein, the remote 
control device may fetch a GUI to provide the appropriate control fimction. In a modification, 
the remote control may include a display thereon for displaying the fetched GUI, thus 
eliminating a need for a separate display on a cheat device. Tht invention tiius permits the 
remote control to access and control a plurality of devices using a single remote control and a 
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single display, with a single method of display and operation, without requiring any change in 
the mode of operation thereof to change the device controlled thereby. 

The foregoing description of fhe preferred embodiment of the invention has been 
presented for purposes of illustration and description. It is not intended to be exhaustive or to 
limit the invention to the precise forms disclosed, since many modifications or variations 
thereof are possible in light of the above teaching. All such modifications and variations are 
within the scope of the invention without departing fiom the broader spirit and scope of the 
invention. The embodiments described herein were chosen and described in order best to 
explain the principles of the invention and its practical application, Aercby to enable others 
skilled in the art to utilize the invention in various embodiments and with various 
modifications as are suited to the particular use contemplated therefor. It is intended that the 
scope of the invention be defined by the daims appended hereto* vAnsa interpreted in 
accordance with the fiill breadth to which they are legally and equitably entitled. The 
specification and drawings are, accordingly, to be regarded in an illustrative rather than a 
restrictive sense. 

Those skilled in the art will appreciate that various adaptations and modifications of 
the just-described preferred embodiments can be configured without departing from the scope 
and spirit of the invention. Therefore, it is to be understood that, within the scope of the 
expended claims, the invention may be practiced other than as specifically described herein. 
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CLAIMS 

What is Claimed Is : 

1. A method for pexfbzming a service on a home netwotk having a plurality of home 
devices connected hereto, the method comprising the steps of: 

connecting a client device to the home netwotk, wherein the device is capable of 
displaying a tiscr interface; 
5 executing a software agent on the client device, wherein executing the software agent 

causes a user interface to be displayed on the client device; 

selecting a first home device from the user interface being displayed on ihc device, 
wherein the first home device is cotmected to the home network; 

selecting a second home device from the user interface being displayed on the device, 
1 0 wherein the second home device is coimected to the home network; and 

sending control and command data finm the client device to the first and second home 
devices to cause the first and second home devices to communicate with each other to peifomi 
the service. 

2. The method of Claim 1 , wherein the step of executing a software agent con^uises 
executing a session manager program for acting on behalf of the user and for assisting the Mset. 

3. The method of Claim 2, wherein the client device includes means for generating a 
himian graphical user interface (GUI), and the step of executing the session manager on the 
client device includes the step of generadng and displaying on the client device a graphics user 
interface object page containing device btxttons associated with the first home device and the 

5 second home device. 

4. The method of Claim 2, wherdn the client device includes a browser means for 
generating a human graphical user interfrtce (GUI). 
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5. The method of Claim 4. wherein the graphics user interface is cbded in HTML, 
wherein the HTML coded graphics user interface object includes a page containing device 
buttons associated with the first home device and the second home device. 

6. The method of Claim 1 , wherein: 

the step of selecting the first home device includes the step of selecting at least one 
information sink-like home device; and 

the step of selecting the second home device includes the step of selecting an information 

source-like home device. 

7. The method of Claim I » herein: 

the step of selecting the first home device includes the step of selecting a source-like 
home device; and 

the step of selecting the second home device includes the step of selecting at least one 
sink-like home device. 

8. The method of Claim 1 . wherein: 

the step of selecting the first home device includes the step of reading a first home device 
capabiUties file, wherein the first home device capabUities file identifies the capabilities of the 
first home device; 

the step of selecting the second home device includes the steps of reading a second home 
device capabiUties file. vAerein the second home device capabUities file identifies the 
capabilities of the second home device, and 

further including the step of matching contents of the first and second home device 

capabiUties files. 
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